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Safe Harbor Statement 

The following is intended to outline our general product direction. It is intended for 
information purposes only, and may not be incorporated into any contract. It is not a 
commitment to deliver any material, code, or functionality, and should not be relied upon 
in making purchasing decisions. The development, release, and tinning of any features or 
functionality described for Oracle’s products remains at the sole discretion of Oracle. 
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Context 
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Profiling 


• Branches with counts (if, switches, ...) 

• Types with counts (virtual calls, checkcasts, ...) 

• Exceptions at calls 
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Motivating Examples 


if (unlikely ()) { 
// complex 
} else { 

// simple 

} 
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Motivating Examples 


if (a instanceof Foo) { 

// ... 

> 
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Motivating Examples 


Foo f = getFooO ; 


class Foo { 

if (f .get () ) { 


public boolean get() 

// complex 


{ 

} else { 


return false; 

// simple 


} 

} 


} 
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Motivating Exam pies 



CheckCastException NullPointerException 


Double a[] = 

double d= a 

(Double [] ) o . get ( ) ; 


NullPointerException 

Array IndexOut Of BoundsException 





NullPointerException 
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Speculative Optimizations 


An optimization is speculative if it relies hypotheses that 
are not verified during compilation. 


ORACLE 


Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | 


9 



Guards 


Guards check conditions during execution and 
deoptimize on failure. 


Deoptimization exits the compiled code and resumes 
execution in the interpreter. 
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Assumptions 


Assumptions are speculative invariants maintained by 
the VM. 

When invalidated, the VM pauses execution and 
deoptimizes all code that relied on this assumption. 
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Revisiting the Examples 


if (unlikely ()) { 
// complex 
} else { 

// simple 

} 
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if (unlikely ()) { 
deoptimize ; 

} 

// simple 
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Revisiting the Examples 


if (unlikely ()) { 



// complex 


if (unlikely ()) { 

f = new FooO ; 


deoptimize ; 

} else { 


} 

// simple 


// simple 

f = new Bar(); 


f = new BarQ; 

} 
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Revisiting the Examples 


if 


(a.getClassO 

// ... 


> 


Foo. class) { 
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Revisiting the Examples 


Foo f = getFooO ; 
if (f .get ()) { 

// complex 
} else { 

// simple 

> 
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Revisiting the Examples 
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Speculation: Run-time Costs 


Guards are run-time checks executed by the compiled 
code 
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Speculation: Memory Costs 


Inlining ^ 





1 

Method & program counter 
Local variables 
Stack variables 
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MiB 


Speculation: Memory Costs 

Code cache memory footprint 
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MiB 


Speculation: Memory Costs 

Code cache memory footprint 
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code-load deltablue 




gbemu navier-stokes raytrace 


box2d 
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crypto earley-boyer mandreel pdfjs 

Code ■ Deopt. metadata ■ Const, metadata Other metadata 
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richards 
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Deoptimization Targets 


• • • 


put field #a 
putfield #b 



parse 



/ > 

Deoptimize 
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transform 





speculation with run-time check 
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Deoptimization Targets 


Two side-effecting instruction can only be reordered if 
there is no deoptimizing instruction between them. 
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Deoptimization Targets 




putfield #a 


putfield #b 




Deoptimize 
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parse 



i 

Write #a 

“IT 

▼ 

/ * \ 

— If 


i 


Write #b 


X 


i 


Write #a 
I 


i 


Write #b 


I 


speculation with run-time check 
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Deoptimization Targets 


If there is a deoptimizing instruction between two side- 
effecting instructions, the deoptimization target must be 
between the corresponding side-effecting bytecodes. 
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Intermediate Representation 


cond 




A 

data-flow 

control-flow 

T 
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Intermediate Representation 


cond 



schedule 



vl 


ORACLE' 


Copyright © 2016, Oracle and/or its affiliates. All rights reserved 

















Intermediate Representation 



• No irreducible control-flow 

• Explicit loop structure 
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Optimization Stages 


compilation 


1 st Stage 


Transition 


2 nd Stage 


t 


1 

1 . 


Speculative optimizations: 

• Deoptimizing instructions can be added 
and moved. 

• Side-effecting instructions remain fixed 


I 

• Optimizations of the schedule of side-effecting 
instructions 

▼ • Deoptimizing instructions remain fixed 
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Optimization Stages: 1 st Stage 


■■■ objl 1 obj2 
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Optimization Stages: Transition 



guard 

lowering 
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Optimization Stages: Transition 



FrameState 

assignment 
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Optimization Stages: 2 nd Stage 
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Optimization Stages 


compilation 





Guard lowering 


1 st Stage 


| Speculative optimizations: 

• Floating guards 

• FrameState at side-effecting instructions 

I 


FrameState assignment 

2 nd Stage 


T 


t 


Optimizations of the schedule of side-effecting 
instructions: 

• Fixed guards 

• FrameState at deoptimizing instructions 
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Speculative Guard Motion 

i 


Begin 


i 


LoopBegin 


c 

A 



LoopExit 



‘ ^ 


V \ 

Guard 



LoopEnd 
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boolean c = . . . 
for (...) { 
if (...) { 
guard (c) ; 

} 

} 
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Speculative Guard Motion 

i 


Begin 


± 


LoopBegin 


c 

A 




‘ 

V 1 

/ > 

Guard 



^oopEnd 


ORACLE' 




Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | 


35 















Speculative Guard Motion 


• Refinements: 

- Rewrite induction variable comparisons 

i<c -> min(i) < c && max(i) < c 

- Processing order 

Hoisting a guard may make new code loop invariant and allow other guards to be hoisted 

- Check relative frequencies 
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Speculative Guard Motion 


• Refinements: 

- Rewrite induction variable comparisons 

i<c -> min(i) < c && max(i) < c 

- Processing order 

Hoisting a guard may make new code loop invariant and allow other guards to be hoisted 

- Check relative frequencies 
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Speculative Guard Motion 


for (int i = 0; i < n; i++) { 


guard (a != null); 

II 

II 

XI 


for (int i = 0; i < n; i++) { 

if (x > 100) { 


x = ...; y = ...; 

guard (a != null); 


if (x > 100) { 

guard(i < a. length); 


guard(i < a. length); 

y "= a[i] ; 


1 

II 

p 
1 — 1 
H- 

i i 

> 


> 

} 


> 
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Speculative Guard Motion 


for (int i = 0; i < n; i++) { 


guard (a != null); 

II 

II 

XI 


for (int i = 0; i < n; i++) { 

if (x > 100) { 


x = ...; y = ...; 

guard (a != null); 


if (x > 100) { 

guard(i < a. length); 


guard (n <= a. length); 

y "= a[i] ; 


1 

II 

p 
1 — 1 
H- 

i i 

> 


> 

} 


> 
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Speculative Guard Motion 


for (int i = 0; i < n; i++) { 


guard (a != null); 

II 

II 

XI 


guard (n <= a. length); 

if (x > 100) { 


for (int i = 0; i < n; i++) { 

guard (a != null); 


x = ...; y = ...; 

guard(i < a. length); 


if (x > 100) { 

y "= a[i] ; 


1 

II 

p 
1 — 1 
H- 

i i 

> 


> 

} 


> 
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Alias analysis 




guard (c != a); 

for (int i = iO; i < a. length; ++i) { 
c [i] = a[i-l] *2 + 1; 

} 
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Safepoint Elimination 


for (int i = 0; i < n; i+=2) { 
safepoint () ; 

} 



guard (n < MAX_ INTEGER) ; 

for (int i = 0; i < n; i+=2) { 

} 
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Deoptimization Grouping 
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Deoptimization Grouping 


10 11 vO 



High-level IR 
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Low-level 

deoptimization metadata 
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Debug Info Sharing 
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Debug Info Sharing 
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Debug Info Sharing 
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Debug Info Sharing 
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bar(x) @ bci 15 
x : rbx 
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Deoptimization Grouping 


Memory footprint of compiled code normalized to baseline 


(lower is better) 


100 . 00 % 

80 . 00 % 

60 . 00 % 

40 . 00 % 

20 . 00 % 

0 . 00 % 
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Sharing 
■ Grouping 
Sharing & Grouping 
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Loop Fusion 

double [] b = new double [a. length] ; 

for (int i = 0; i < a. length; ++i) { 
b[i] = a[i] * 2; 

} 

doubled c = new double [a. length] ; 

for (int i = 0; i < a. length; ++i) { 
c [i] = b[i] +1; 

} 

W 

doublet] c = new double [a. length] ; 

for (int i = 0; i < a. length; ++i) { 
c[i] = a[i] *2 + 1; 

} 
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Effect Sinking 
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int 

tx = 

this 

.x; 

for 

(int 

i = 

iO; i < n; ++i) { 

tx 

= tx 

: * 2 

+ l; 

} 




this 

.x = 

tx; 
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Questions 
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